Gradient Representations and the Perception of Luminosity 
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The neuronal mechanisms that serve to distinguish between light-emitting and light reflecting ob- 
jects are largely unknown. It has been suggested that luminosity perception implements a separate 
pathway in the visual system, such that luminosity constitutes an independent perceptual feature. 
Recently, a psychophysical study was conducted to address the question whether luminosity has 
a feature status or not. However, the results of this study lend support to the hypothesis that 
luminance gradients are instead a perceptual feature. Here, I show how the perception of luminos- 
ity can emerge from a previously proposed neuronal architecture for generating representations of 
luminance gradients. 

Keywords: Luminance, gradients, brightness, lightness, luminosity, surfaces, Ehrenstein, Chevreul, glow, 
fluorent, Mach, highlight 



I. INTRODUCTION 



Under daylight illumination conditions, looking at a 
television or computer screen rarely produces the sen- 
sation that displayed items are light-emitting, although 
each pixel of the screen emits light ([4l|, with references). 
But to perceive objects as being luminous, it is not neces- 
sary to have a physically source of light emission. Halos 
were used by artists since a long time as a means to cre- 
ate luminosity effects in their paintings ([4l|, with refer- 
ences). When a region is painted with a halo surrounding 
it, then one perceives this region with enhanced bright- 
ness, or even as glowing, without physical light emis- 
sion being present. Thus, the perception of glow can be 
evoked on (light reflecting) paper or canvas, and text or 
pictures being displayed on a (light emitting) computer 
screen are not necessarily being perceived as luminous. 
In other situations perception and physics are not diver- 
gent. For example, the sun is always perceived as light 
emitting, and so are stars at night. In such situations, 
the strong contrast between light sources and background 
may provide the key factor to the perception of luminos- 

ityUi- 

A recent fMRI study has identified a region in the brain 
which seems to be associated with the perception of lu- 
minosity [131 • In this study, different configurations of 
the glare effect display ([J, [H, figure [5l top row) 
were presented to human observers. The results of the 
study were indicative to that luminosity might constitute 
a perceptual feature much like contrast, orientation, mo- 
tion, or faces. The question about whether luminosity 
is a perceptual feature or not motivated a correspond- 
ing psychophysical study 0- The study was based on 
the idea that perceptual features are distinguished from 
other object properties by being processed in a more effi- 
cient way. This means that visual features consume less 



attentional resources than non- features [l8|, what is re- 
flected in, for example, "pop out" effects. A visual search 
paradigm such as the one used in the study of 3 1 there- 
fore can serve to distinguish features from non-features. 
Unexpectedly, the results of Correani at al. are compat- 
ible with that luminance gradients instead of luminosity 
are a visual feature. Several authors have already for- 
mulated the hypothesis that luminance gradients are in- 
volved in the perception of luminosity [H, \^ [4l|, , as 
there is evidence that luminance gradients can influence 
lightness perception under certain circumstances. 
I therefore asked whether a recently proposed theory 
for the perception of luminance gradients ( "gradient sys- 
tem") could account for the just-described observations. 
The gradient system has been successful in. quantitatively 
predicting available data on Mach bands [22| . It further- 
more provided an account for Chevreul's illusion in terms 
of luminance gradients [20j , and in addition is capable of 
real-world image processing. 

In this work I will show how spatial configurations of 
luminance gradients can interact to produce the percep- 
tion of luminosity in the absence of physical illuminants. 
The results presented here also contribute to the fur- 
ther understanding of how luminance gradients interact 
with lightness computations and brightness perception, 
respectively. Specifically, representations of luminance 
gradients provide a straightforward explanation of "self- 
luminous grays" jU, \^ , and why it is that perception 
of luminosity is independent from lightness anchoring. 



II. INTRODUCING THE GRADIENT SYSTEM 



This section provides an overview over important char- 
acteristics of the gradient system. A more detailed de- 
scription of it, as well as its formal definition, can be 

*Electronic address: ' matsATcvc.uab.es; threequarksATyahoo.com; AT=t@lj ind in [20j and [2^ . 
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FIG. 1: Functional overview over the gradient system. 

A notched square wave grating (or briefly "notch grating") is 
used for illustration of the processing stages. A notch grating 
is a square wave with notches being centered at each lumi- 
nance step, and luminance decays (for the bright stairs) and 
increases linearly (for the dark stairs), respectively, to a com- 
mon luminance level (the luminance profile is shown in fig- 
ure [2]). This means that the faint lines centered at each step 
have the same intensity value, yet they are perceived with dif- 
ferent brightness. See section Hi B I for a detailed explanation 
of the processing stages. 



A. Motivation 

The original motivation for proposing representations 
of luminance gradients was that they are of different 
utility for object recognition. It is known, for example, 
that they may aid to (i) recover three-dimensional 
information to compute surface shape (shape from shad- 
ing, e.g. d^, nil), (ii) to resolve the three-dimensional 
layout of visual scenes (e.g. 0, nil), (Hi) to identify 
material properties of object surfaces (e.g., mat versus 
glossy), and are therefore complementary to lightness 
computations (lightness is associated with surface 
representations) . 

In situations, however, it may happen that luminance 
gradients rather would interfere with the goal of gener- 
ating invariant surface representations, and thus disrupt 
lightness constancy. (Invariant surface representations 
are mandatory for robust object recognition). In natural 
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FIG. 2: Gradient enhancement and contours {— non- 
gradients). The notched square wave grating (or briefly 
"notch grating" , legend label "luminance" ) is a periodic spa- 
tial pattern composed of step-like changes and linear lumi- 
nance gradients (the notches). Contours are detected at the 
step-like changes in luminance. Contours are related to sur- 
face processing, and thus should be suppressed in gradient 
representations. In the gradient system, the suppression is ex- 
ecuted by contours acting inhibitory (see legend label). This 
non-gradient inhibition leaves just those activity patterns in 
retinal channels which correspond to smooth changes in lu- 
minance {gradient ON activity "(-I-)", and gradient OFF ac- 
tivity "(—)"; c.f. figure [!}. During the creation of a gradi- 
ent representation, gradient ON and OFF patterns eventually 
act as sources and sinks, respectively. Depending on whether 
sources and sinks correspond to a linear luminance gradient 
(as shown here) or not, a gradient has to be explicitly be 
generated or not, respectively (see figure |3j. 



scenes, specular highlights, cast shadows, and slow 
illumination gradients are often superimposed on object 
surfaces. In such cases, luminance gradients must be 
suppressed in surface representations for establishing 
lightness constancy. Nevertheless, it has been demon- 
strated recently that humans use cues such as shadows, 
shading and highlights for segregation of object surfaces 
9]. Thus, lightness constancy implies discounting 
"gradient features" on the one hand, yet on the other 
hand they are used by humans to achieve a more reliable 
segregation of figural regions from the background. 
Taken together, luminance gradients contain different 
information, which cannot be interpreted by bottom-up 
mechanisms. Without segregating them from surfaces, 
surface representations would vary as a function of illu- 
mination conditions and scene layout. Notice that such 
a merged representation would necessitate segregation 
anyway, as lightness constancy is not interrupted by 
specular highlights [36| . and human object recognition 
seems to work reliably for most illumination conditions 
and scenes. 

Having separate representations for surfaces and 
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FIG. 3: Linear and nonlinear luminance gradients. 

(Both plots show activity profiles of two-dimensional repre- 
sentations at different times - see legend). Linear luminance 
gradients (a) are processed by the gradient system differently 
to nonlinear gradients (b). In the former case, an activity 
gradient has to be explicitly generated by lateral spread of 
activity between a brightness source and a brightness sink (a 
a matter of fact, a brightness source is equivalent to a darkness 
sink, and a brightness sink is equivalent to a darkness source). 
Sources and sinks may be localized activity patterns as in (a) 
(where they are indicated by arrows), but be also spatially 
more extended as in (h) (i.e., for nonlinear luminance gradi- 
ents) . In the initial gradient representation, sources and sinks 
of nonlinear gradients are just a low-activity version of their 
final representation. Thus, representations for nonlinear lu- 
minance gradients are produced by only amplifying the initial 
activity pattern, similar to a standing wave with increasing 
amplitude. The corresponding luminance displays and their 
gradient representations in 2-D are shown in figure [TB] 



gradients, however, has the advantage that gradient 
representations could be dynamically linked to lightness 
computations (ssj . In this way, mechanisms for object 
recognition could utilize or suppress corresponding in- 
formation, what could contribute to increase robustness. 



B. How it works 

The gradient systems is a hypothetical neuronal cir- 
cuit, and its main processin g st ages are shown in fig- 
ure [1] (see also figure 1 in [22'|). The retina consti- 
tutes two pathways, which are related to brightness 
( "ON-channel" ) , and darkness ("OFF-channel"), respec- 
tively. A high-resolution boundary map is produced by 
processing information from both channels [43.]. "High- 
resolution" is to say that only the finest scale is con- 
sidered. At a cortical level, boundary maps are usu- 
ally regarded as demarcating surface representations thus 
defining surface shape. Because contours define surfaces, 
but not gradients, they are referred to as non- gradients 
within the gradient system. Non-gradients act always in- 
hibitory (figure [2]). 

In the first step of gradient processing, gradients are en- 
hanced by suppressing ON- and OFF-activity at non- 
gradient positions. The result of this process can be con- 
ceived as "retinal activity maps with erased contours" 
("gradient ON" & "gradient OFF" in figure [T|). 
In the second step, retinal ON-activity and gradient 
ON-activity provide excitatory input to the site labeled 
by "-I-" in figure [T] Analogously, OFF-activity from 
retina and gradients act inhibitory on the site labeled by 
"— Excitation and inhibition is tonic or clamped, 
what means that activity is actively generated at "-I-" 
and "— . In addition, activity spreads laterally: Activity 
values with positive sign from "-f " , and negative values 
from "— " . Silent (or shunting) inhibition (reversal po- 
tential equals resting potential that is zero) exerted by 
non-gradient features during activity propagation quickly 
suppresses boundaries, while at the same time gradient 
activity is further enhanced. As a consequence, sources 
and sinks are dynamically created[45j. Because of lateral 
propagation processes, activity gradients will eventually 
form between sources and sinks (but see figure [p. This 
latter process is referred to as clamped diffusiov^Bt. [2^ . 
Silent non-gradient inhibition imposes a further impor- 
tant constraint on the creation of gradient representa- 
tions: Gradients cannot spread beyond a surface over 
which they were originally superimposed. This constraint 
also implies that activity gradients could form between 
a source and a site of active non-gradient inhibition, but 
also between a sink and a site of active non-gradient in- 
hibition. Such behavior occurs, for example, with the 
notched square wave grating ( "notch grating" , figures [U 

ElIll&IISl). 

The gradient system generates representations of linear 
luminance gradients by lateral propagation of activity be- 
tween a brightness source and a brightness sink. At equi- 
librium, an activity gradient has formed between source 
and sink (figure [3h). 

On the other hand, nonlinear luminance gradients, such 
as sine wave gratings, need not to be explicitly created 
as it is the case with linear gradients. Rather, the ini- 
tial activity pattern is only amplified (figure [3^). Notice 
that representations of linear and nonlinear gradients are 
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generated by the same mechanism, that is clamped dif- 
fusion. 

Summarizing, there are three components which influ- 
ence in the generation of gradient representations, (i) 
Brightness sources are created from the retinal ON- 
channel, and their activity is related to "brightness". 
Brightness sources constantly generate activity with pos- 
itive sign. This activity propagates laterally, ('ii^ Bright- 
ness sinks are the counterpart of brightness sources, and 
originate from the retinal OFF-channel. Brightness sinks 
are are identical with darkness sources, because they gen- 
erate negative-valued activity. By the same arguments 
are brightness sources identical with darkness sinks. If 
a stimulus only contains luminance gradients, then only 
brightness sources and brightness sinks will influence in 
the formation of gradient representations, where activity 
gradients will form between sources and sinks (or be- 
tween brightness sources and darkness sources), (in) If 
the stimulus, however, contains surface structures, silent 
non-gradient inhibition will be evoked, which strictly 
speaking acts as an activity drain for both brightness and 
darkness activity. Non-gradient inhibition, however, does 
not actively generate activity. To avoid name clashes, 
the terms "sources" and "sinks" are exclusively reserved 
for brightness sources and brightness sinks, respectively. 
The term "drain" is used to refer to activity dissipation 
because of non-gradient inhibition, (iv) Representations 
of linear and nonlinear luminance gradients are generated 
by the same mechanism (clamped diffusion). 



the range from (black) to 1 (white). 

IV. RESULTS OF SIMULATIONS 

A. The glare effect 

In the present study, the glare effect display was sys- 
tematically modified and corresponding responses of the 
gradient system were studied. The original glare effect 
(as introduced in (40| ) is shown in the first image of fig- 
ure [H It consists of a chessboard image {carrier)^ in 
which four black squares were substituted by luminance 
ramps [inducer squares). The white field of the chess- 
board which is surrounded by the luminance ramps is 
the target square or central square. Notice that the ramps 
are linear gradients. Depending on the spatial arrange- 
ment of the luminance ramps with respect to the central 
square, it is perceived as being light-emitting in the glow 
setup (all images in figure[31 first image in figurel^l) . If the 
luminance ramps are arranged according to the scrambled 
setup or the halo setup (figure [5]) , then one cannot ob- 
serve any brightness enhancement of the central square 
0,[23. Similarly, no brightness enhancement occurs in 
the control configuration, where the four inducer squares 
are set to a homogeneous luminance value - the mean 
value of a inducer square. 

B. Simulations of different setups 



III. MATERIAL AND METHODS 

All results were generated with the implementation of 
the gradient system as described in [S^] , and [13] , respec- 
tively. All parameter values and numerical methods were 
also the same for the present study as before. Simulations 
were carried out with a Matlab environment (R2006b) 
on a Linux workstation. If not otherwise stated, gradi- 
ent representations were evaluated at tmax = 1000 it- 
erations. For the figures [51 [H] and [T31 gradient activity 
was averaged across the positions of the central square 
of the input (see figure |4|) . Spatial averaging was car- 
ried out separately for brightness (i.e., positive values) 
and darkness (i.e., negative values), respectively. In both 
of the last figures, the figure label "perceptual activity" 
means that the absolute value of average darkness was 
subtracted from average brightness at each data point. 
In figure [T^ only brightness activity is shown, as the first 
data point of all curves (corresponding to luminance zero 
of the central square) gave —0.0022 for computing aver- 
age brightness minus average darkness, and the abscissa 
was scaled logarithmically. Each of the images in figure 
and [7] showing gradient representations were normalized 
individually in order to improve the visualization. For 
the figures [TU] and [Til the image size was 256 x 256 pix- 
els. For the rest of the simulations, luminance displays 
were of size 128 x 128 pixel. Luminance values were in 



The bottom row of figure [5] ( "gradients" ) shows gra- 
dient representations which have been generated from 
the images shown in the first row ("setup"). The gra- 
dient representation produced by the glow setup shows 
a neon-like square that is located along the contours of 
the central square. Because linear gradients (i.e., lumi- 
nance ramps) were used as inducers, each side of the 
neon-square actually corresponds to a bright Mach-band 
[m . In the course of clamped diffusion dynamics (second 
stage of the gradient system), the Mach bands implement 
brightness sources, from which activity spreads later- 
ally to generate representations of luminance ramps (the 
dark Mach band constitutes the corresponding brightness 
sink). In the glow setup, the four Mach bands are situ- 
ated around the central square, thereby forming a closed 
region where gradient brightness accumulates over time 
(figure [3) &[Tni). In other words, although there is no 
(physical) luminance gradient present across the central 
square, it is "tagged" with strong gradient brightness. 
Because activity does not dissipate (i.e., there is no drain 
or brightness sink across the target), and because bright- 
ness sources constantly generate activity, overall bright- 
ness activity eventually grows higher than darkness ac- 
tivity. Thus, "perceived brightness" is higher than "per- 
ceived darkness" in the final representationji^, and the 
central square will appear luminous. 
In the control setup, no luminance gradients are present. 
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FIG. 4: A glow parade. The figure shows three modifications ("open giow", "glow-2", and "fluorent") of the original glare 
effect display shown in the first row ("glow") at four spatial frequencies of the chessboard carrier (number denoting columns 
correspond to cycles per image). Gradient representation of these images are shown in figure [T] The center square of each 
image appears as being light-emitting, albeit the strength of the effect seems to depend on display configuration and spatial 
frequency. 



glow control scrambled halo 





FIG. 5: Setups. The top row defines the four setups glow, 
control, scrambled, and halo as employed in the present study 
(setups are distinguished by italic letters). The definition fol- 
lows the luminance displays as they were introduced in the 
study of 0]. Self- luminosity is only perceived for the glow 
setup, but in none of the other cases. Notice, however, the 
light Mach bands at the white end of the ramp for the scram- 
bled setup (the Mach bands are reproduced as white lines 
in the gradient representations). The bottom row shows the 
corresponding gradient representations. 



The corresponding gradient representation has low activ- 
ity, with similar amphtudes of brightness and darkness. 



Due to the absence of brightness and darkness sources, 
no lateral spread of activity occurs, and activity across 
the central square is close to zero (as indicated by gray 
colors in figure [51 see also figure . In the scrambled 
setup, again bright Mach bands (i.e., brightness sources) 
are created. However, the contour of each ramp, along 
which luminance increases, contrasts strongly with the 
central square. These contrasts are "non-gradients" and 
constitute barriers for the propagation of gradient activ- 
ity. Thus, no brightness activity originating from the 
Mach bands can propagate into the central square, and 
no brightness enhancement of the latter occurs. The gra- 
dient representation that is created for the halo setup is 
similar to the control setup. Notice, however, that nei- 
ther bright Mach bands nor activity gradients are created 
at the bright side of each ramp. This is due to a strong 
contrast with the domain boundary, as a consequence of 
the domain boundary conditions which were used for the 
simulation (c.f. ^ or [22]). 

The predictions of the gradient system can be summa- 
rized as follows (c.f.figurc [TU)) . A target region is per- 
ceived as being light-emitting if in its gradient represen- 
tation it is tagged with high brightness activity, despite of 
the absence of actual luminance gradients across that tar- 
get. The target is filled in with brightness ii (i) brightness 



6 





■ ■ ■luminance 

control 
^halo 
— scrambled 
— glow 








7 V 



position 

(a) 




position 

(b) 

FIG. 6: Profiles of gradient representations shown in 
figure [5j (a) The curves correspond to horizontal profiles 
of the 2-D gradient representations shown in figure [5] (pro- 
files show all columns for the center row of a 2-D display). 
Each curve thus represents a different setup as denoted by 
the legend, (b) Profile plots of gradient representations at 
different simulation times (see legend) for the second image 
of figure [4] (spatial frequency 2.5 cycles per image). Note the 
elevated gradient brightness activity (positive values) across 
the central square. At time 1, non-zero gradient activity is 
obtained only at Mach band positions, but not across the cen- 
tral square. However, during the generation of the gradient 
representation, the central square gets filled in with bright- 
ness. This fiUing-in effect occurs only for the glow setup, but 
not for any of the others. Curves representing luminance were 
rescaled independently for both plots (original luminance val- 
ues ranged always from to 1). 



sources are located sufficiently close to it, and if (ii) no 
activity is annihilated because of the presence of drains 
or sinks nearby or across the target. Then, brightness can 
accumulate (i.e., activity grows in time across the target 
region), and finally gets much higher than darkness ac- 
tivity, such that luminosity is perceived (a strong excess 
of brightness over darkness). This situation is typically 
created by the presence of linear luminance gradients ad- 
jacent to the target. These predictions are examined 
further in the following section by introducing specific 



modifications of the original glow setup. 

C. Modifications of the glare effect display and size 
effects 

Figured] shows three modification of the original glare 
effect display which also lead to the perception of lumi- 
nosity. The corresponding gradient representations are 
shown in figure [T] 

Open glow. Each luminance ramp was shifted by 32% 
(of the square length in pixels) to the darker side, 
and the total ramp size was reduced to 75%. Still 
a glowing effect can be observed. The gradient sys- 
tem consistently predicts this effect - brightness of 
the ramp accumulates in the central part of the im- 
age, although activity propagation now takes place 
over a larger region than the central region of the 
original display, and despite of the target region be- 
ing no longer tightly enclosed by the Mach bands. 

Glow-2. A glow effect is also seen with only two lumi- 
nance ramps. However, this effect is weaker be- 
cause brightness activity can escape at the top and 
the bottom into the white regions adjacent to the 
target region. 

Fluorent. The top and the bottom side of the central 
square is now enclosed by uniform black squares. 
The boundaries of each black square give rise to 
non-gradient inhibition, thus implementing activity 
drains at the central square (figure [Tl|) . Therefore, 
brightness enhancement should be weaker com- 
pared to the glow-2 display. In fact, the sensation 
appears to be what has been described as "prelu- 
minous super white" [IB] or fluorent" Q. 

Because all of the glow effects presented in this paper are 
induced by linear luminance ramps, and because Mach 
bands are attached to linear luminance ramps, the glow 
effects should also depend on ramp width or scale, respec- 
tively. The perceived strength of Mach bands is small 
for narrow ramps, large at ramps of intermediate size, 
and decreases again with broad ramps ("inverted-U"- 
behavior, [s^). Increasing the spatial frequency of the 
chessboard carrier decreases both the ramp width, and 
the size of the central square. Figure 2] illustrates the 
dependence of the perceived glowing strength on spa- 
tial frequency for 1.5, 2.5, 3.5, and 8.5 cycles per im- 
age. Although precise psychophysical data concerning 
this spatial frequency dependence are not (yet) available, 
some of the effects seem to be stronger at an intermedi- 
ate frequency. The gradient system clearly suggests a 
relationship between carrier frequency and glow strength 
(figure [7]). Notice, however, that the gradient system 
is not calibrated with respect to viewing distance, and 
maximum effects may be predicted at different spatial 
frequencies than perceived by humans when looking at 
figure m 
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FIG. 7: Gradient Representations for figure |4l Each image has been normalized individually to improve visualization. 
Darkness activity of gradient representations corresponds to dark colors, and brightness activity to bright colors. 
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FIG. 8: Varying spatial frequency (setups). The curves 
show gradient activity averaged over the central square of the 
glare effect display for various spatial frequencies of the chess- 
board carrier. Each curve represent a different setup (legend 
- see figure [5]) . The gradient system predicts relative high 
activities across the central square only for the glow setup, 
where humans perceive the central square as being luminous. 



In figure [51 the strength of glowing is quantified in terms 
of the mean gradient activity over the central square for 
different spatial frequencies of the chessboard carrier (see 
section HIT)) ■ A maximum effect is predicted for the glow 



setup, but no brightness enhancement of the target does 
occur for the setups scrambled^ halo, and control. In fig- 
ure [51 the strength of glowing is measured both by com- 
puting the mean activity over the central square (a) and 
the maximum (6). The glow display is predicted to pro- 
duce the strongest effect f figure [T0|. and the fluorent dis- 
play to produce the weakest (figure [TT|) . The important 
result with these curves is the prediction of a maximum 
at some intermediate spatial frequency. Notice, however, 
that the curves shift along the ordinate depending on 
whether the spatial average across the central square was 
computed, or the maximum value was taken. This is be- 
cause the central square is not filled in homogeneously 
with brightness activity, but gradient activity rather de- 
creases towards the center of the central square (figure[ni) . 
This "bowing effect" is especially prominent with larger 
region sizes or at low spatial frequencies, respectively (cf. 
figure [7|). 



D. Glowing grays? 

[i^ reported the perception of "glowing grays" [3§| in 
a psychophysical experiment where subjects first had to 
adjust the central square of a chessboard display until 
it was perceived as white (no luminance gradient was 
present in this display). Next, they were asked to adjust 
the central square of a second display until it was per- 
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FIG. 9: Varying spatial frequency (displays). Both plots 
show the gradient activity of the central square for the differ- 
ent types of luminance displays shown in figure|4]with spatial 
frequencies indicated on the abscissa. Display types are de- 
noted in the legend. For the open glow display, the central 
square region for measuring gradient activity had to be ex- 
panded by 32% to each side in order to capture the full effect, 
(a) The gradient activity is measured by spatial averaging ac- 
tivity values over the central square, (b) The maximum value 
of gradient activity over the central square was computed. 
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FIG. 10: Why the glow display produces the strongest 
effect, (a) The glow display (c.f. figure |4ll (b) (Bright- 
ness) sources are designated with "-(-" , and (brightness) sinks 
with "— " . An activity gradient will form between sources and 
sinks: The arrows designated by "G" indicate the direction 
of gradient formation from increasing to decreasing perceived 
luminance. Notice that the central (or target) square is sur- 
rounded by four brightness sources, (c) The boundary map 
is equivalent to locations where non-gradient inhibition is ac- 
tive. It is assumed that surface representations are triggered 
there. No boundaries are present around the target square, 
and thus no non-gradient inhibition is produced, (d) Since 
brightness sources constantly generate activity, and no loss of 
activity occurs across the central square (due to the presence 
of a brightness sink or non-gradient inhibition), brightness 
activity can accumulate (small arrows; see also figure |6]). Ac- 
cumulated brightness over the target square is proposed to be 
associated with the perception of luminosity. Notice that the 
activity gradients do not extend into the four white squares 
in the corners because of non-gradient inhibition. 



ceived to glow (the image for their second display was 
identical to the glow setup in figure [5]). The experiment 
was carried out for three different luminance levels of the 
(originally white) squares in the corners of the display 
(= background luminance). The authors observed that 
subjects did not adjust the central square of the glow dis- 
play to white. In other words, it was already perceived 
as glowing at some gray level. 

Figure [12] shows the dependence of gradient brightness on 
the luminance level of the central square. Notice that the 
curve for the the glow setup reveals an abrupt increase 
between luminance levels 0.4 and 0.5. In other words, the 
gradient system reveals a threshold behavior [i^], where 
gradient brightness strongly increases with the respect to 
the curves for the other setups scrambled, halo, and con- 
trol. After the step-like increment, the curve shows an 
approximately linear dependence on the luminance level 



of the central square. At luminance « 0.9, the curve re- 
veals a moderate increase in slope. 

Because only the glow setup leads to the sensation of 
glow, and because before the step-like increment gradient 
brightness is approximately the same as with the other 
three setups (which are not associated with the percep- 
tion of glow) , this step- like increment in fact corresponds 
to an absolute threshold for the central square to be per- 
ceived as light-emitting. Moreover, because the step-like 
increment occurs between luminance levels 0.4 and 0.5 
which is associated with mid-gray, the gradient system 
indeed predicts the occurrence of "glowing grays" . 
The background luminance level influences in retinal 
adaptation, and also in lightness anchoring. The present 
version of the gradient system, however, does neither in- 
corporate mechanisms for adaptation, nor does it incor- 
porate interactions with surface representations (or light- 
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FIG. 11: Why the fluorent display produces the weak- 
est effect, (a) The fluorent display (c.f. figure|4]) (b) In com- 
parison to the glow display (previous figure), only two activ- 
ity gradients will be generated (arrows designated with "G"). 
(c) Apart from two brightness sources, the central square is 
now also flanked by two contours ("O") giving rise to non- 
gradient inhibition. As explained in the last paragraph of 
section Hi Bl non- gradient inhibition acts like a passive drain, 
for both brightness sources and brightness sinks, (d) Activ- 
ity propagates from brightness sources into the central 
square, but its accumulation is less than with the glow display 
(figure [TIT)) because it gets annihilated at contours "Q" (small 
arrows). Therefore, the target square of the fluorent display 
will appear less luminous than the target of the glow display. 



ness computations). 



E. Influence of the luminance ramp 

In [4l|, subjects were asked to adjust the height of 
the luminance ramps surrounding the central square of 
a glare effect display (= first image of figure [5]) while 
the central square was always held fixed at white. This 
procedure was repeated for different levels of the four 
(originally white) squares in the corner of the display 
(= background luminance). The authors found that the 
threshold for perceiving the central square as glowing 
(— luminosity threshold) increased with increasing back- 
ground luminance in precisely the same way as the curve 
for the glow setup in figure [T51 (see figure 3 in [41]). How- 
ever, figure [13] does not show luminosity threshold versus 
background luminance, but gradient activity of the cen- 
tral square versus the upper ramp luminance. So why is 
it that both curves are so similar? 

The curve of figure [T51 {glow setup) shows the predicted 
sensation of luminosity given some ramp luminance level 



(as illustrated by figure 1 in [44I). The results from [4l| . 
demonstrate that the luminosity threshold increases as 
a function of background luminance. When comparing 
their results to the predictions of the gradient system, 
it therefore seems that the background luminance level 
sets a baseline level below of which luminosity cannot be 
perceived. This idea is equivalent to putting horizontal 
lines in figure [T51 with an intercept proportional to back- 
ground luminance. Therefore, to perceive luminosity, the 
upper ramp luminance has to be adjusted such that gra- 
dient activity is just above the horizontal line. And this 
is what is shown in figure 1 of [4]| . 



V. DISCUSSION 

A recent psychophysical study from [7], assigned fea- 
ture status to luminance gradients. Accordingly, here 1 
studied the predictions of the gradient system for lumi- 
nance displays which appear self-luminous. The gradient 
system is an instantiation of a recently proposed theory 
about how luminance gradients are segregated from im- 
ages, and how representations of luminance gradients are 
generated [20l[2a|. 

Here I showed that gradient representations have higher 
activity levels across the central square in those dis- 
plays that are associated with the sensation of glow {glow 
setup, figure [5]). Conversely, gradient activity is low in 
displays which are not perceived as light-emitting (setups 
control, halo, scrambled). My results therefore support 
the conjecture from [42] that luminance gradients play a 
crucial role in luminosity perception. 
Three modifications of the glare effect display were de- 
vised (figure!!]) to put to the test the following predictions 
of the gradient system (figure [7]): (i) gradient activity 
accumulates in the central square what predicts a cor- 
responding enhancement in perceived brightness (origi- 
nal "glow" display); (ii) if the central square is enclosed 
by only two luminance ramps ("glow-2" display), then 
gradient activity spreads into the open region, but lu- 
minosity should still be perceived; (in) if the central 
square is delineated by sharp contrasts ("fluorent" dis- 
play), then drains for brightness activities are created 
which should lead to a reduction of the glow effect, and 
finally (iv) as gradient activity spreads laterally origi- 
nating from brightness sources (which are perceived as 
bright Mach bands surrounding the central square), the 
perceived luminosity should depend on the size of the 
target region or the spatial frequency of the chessboard 
carrier, respectively ("open glow" display, and figure [5] & 
figure [9]). 

For the luminance displays considered in this paper, 
the gradient system predicts a threshold behavior above 
which the central square is perceived as being light- 
emitting (the step-like change in figure fT2)) : Light emis- 
sion is already predicted at intermediate luminance val- 
ues ("glowing grays"). In addition, the gradient system 
provides a consistent explanation of the results from [4l| 
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FIG. 12: Varying the intensity of the central square. The curves show the predicted gradient brightness activity as a 
function of the luminance of the central square (sketch) for the setups of the glare effect display (1.5 cycles per image, cf. first 
image in figure |4]). The gradient brightness associated with the glow setup abruptly increases between intensity levels 0.4 and 
0.5 (= step-like increment), whereas a relatively weak dependence on luminance is predicted for the setups scrambled, halo, 
and control. Similar curves are obtained by plotting the maximum activity of the central square. The location of the step-like 
increment does not depend significantly on the spatial frequency of the chessboard carrier. 
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FIG. 13: Varying intensity. The luminance of the central square of the chess ramp display was held fixed at white, and 
the upper knee-point of the ramp was set to different luminance values from black (corresponding to an ordinary chessboard 
without luminance ramps) to white (corresponding to the glare effect display). The shape of the curve for the glow setup 
matches well the psychophysically measured curve shown in figure 3 of [4ll] (but see text for further details). 



(compare their figure 1 with my figure [T3|). 



A. Gradient representations, lightness, and 
brightness 

The gradient system was proposed as one part of three, 
in parallel acting processing streams, for generating 
texture representations [48] and surface representations 
(see [H, HH). Although it is clear that surface represen- 
tations and gradient representations have to interact at 
some level in the object recognition hierarchy (e.g., in 
order to derive shape from shading), it is not clear how 
such interactions could be implemented at an early level 



in the visual system. The original idea was that whenever 
odd-symmetrical and sharply bounded contrasts are 
present in an image, the corresponding information 
triggers the generation of surface representations by 
a fiUing-in process. By contrast, the presence of blur 
or soft contrasts trigger representations of luminance 
gradients (figure [T3] and [15]) . 

The present study suggests that the perception of 
luminosity is associated with gradient representations, 
but not with surface representations. But then, surface 
representations can be directly related to perceived 
reflectance. Otherwise expressed, the perceptual corre- 
late of surface representations is lightness. Reflectance 
describes a property of surfaces which has the value zero 
if the surface absorbs all light (and thus appears black). 
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FIG. 14: How gradient representations relate to the 
filling-in framework. A "notch grating" luminance pat- 
tern ("luminance" arrow) is used to illustrate conceivable in- 
teractions between lightness computations and gradient rep- 
resentations. Contours are detected at the step-like lumi- 
nance changes, what triggers a filling-in process for comput- 
ing surface lightness ("filling-in" arrow; H, [TO]). Filling -m 
processes were suggested as a theoretical mechanism to im- 
plement invariance properties for surface representations, for 
example "discounting the illuminant" to implement lightness 
constancy (e.g., [14|. |15|. l30i. iSll. [3^). As we perceive lightness 
constancy, but at the same time also smooth changes in lu- 
minance [3g|, surface lightness and gradient representations 
need to interact (arrows "1" & "2"). This interaction finally 
is proposed to result in brightness perception. 



and the value one if the surface reflects all light. Gray 
levels are represented by intermediate reflectance values. 
Ideally, lightness should follow reflectance. However, if 
luminosity effects were explained in terms of reflectance, 
this would imply that reflectance values were bigger 
than one, because the surface would emit more light 
than it actually could reflect. 

Furthermore, lightness constancy implies that reflectance 
is perceived as approximately constant despite of vari- 
ations in illumination conditions. Lightness constancy 
seems also not to be affected significantly by the pres- 
ence of specular highfights on surfaces [30|. Gradient 
representations therefore are supposed to contain all 
surface information that otherwise would affect lightness 
constancy and thus object recognition. Taken together, 
luminosity is not perceived on the lightness scale, but on 
the brightness scale. Brightness comprises all perceptual 
aspects of a scene, including lightness and luminosity. 
What happens, however, if surface representations and 
gradient representations are simultaneously triggered 
for one and the same region? This situation occurs, 
for example, with a luminance staircase giving rise 
to Chevreul's illusion (e.g., figure 8 in [205). Because 
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FIG. 15: Gradient and surface representations. The 

curves illustrate a possible mechanism for the interaction of 
gradient representations with surface representations. Each 
curve shows a profile plot (all columns for a fixed row) of 
the images shown in figure [T4l The brightness prediction was 
computed by assuming a simple linear interaction between 
ON- and OFF-channels of surface and gradients (figure title), 
yet it correctly predicts that the faint lines in the center of 
the dark step are perceived brighter than the faint lines of the 
bright step, albeit both lines have the same luminance level. 



Chevreul's illusion commonly is not described as being 
light emitting, it seems that the presence of surface rep- 
resentations weakens the perceptual impact of gradient 
representations in terms of brightness. 
Similarly, for the notch grating stimulus, surface 
representations and gradient representations are si- 
multaneously triggered (figure [14]). More precisely, 
each step-like change in luminance triggers a surface 
representation, and the faint lines centered at each step 
constitute the sources and sinks for producing gradient 
representations (see arrows with corresponding labels in 
figure [H]). 

A possible mechanism for creating surface representa- 
tions are so-called filling-in processes 0, [l3| , which serve 
to assign perceptual properties (e.g . , lightn ess, color, or 
depth) to object surfaces (e.g., [14 [isl. Isol. [sil. Is^). As 
a result, surfaces are rendered invariant against smooth 
changes in the corresponding stimulus attribute. For 
example, smooth luminance gradients are discounted 
in surface representations, and in this way lightness 
constancy is achieved. Nevertheless we still perceive 
luminance gradients, what leads to the question how 
gradient representations interact with surface represen- 
tations. 

Consider the scrambled setup (figure [5|). Although Mach 
bands are perceived, no brightness enhancement of the 
four white squares in the corners of the display seems 
to take place. For each of these squares, a gradient 
representation is triggered at one side (where the Mach 
bands are observed), and a surface representation is 
triggered at the other side (at the lower or dark end of 
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the luminance ramp). 

Similarly, the configuration that has been examined with 
figure [13] corresponds to a situation where a sharply- 
bounded contrast concurs with a ramp (see also figure 1 
in j42,]). But then again, a surface representation (giving 
rise to lightness activity) and a gradient representation 
are generated at the same time for the central square. 
Depending on whether the one or the other representa- 
tion has higher activity, one perceives luminosity (only 
gradient activity), super white (gradient activity and 
lightness activity), or only ordinary "white" (i.e. only 
lightness activity). 

Taken together, these observations support two conclu- 
sions. First, the mechanism for triggering surface or 
gradient representations does not operate in a "all-or- 
none" fashion, but rather operates continuously. Second, 
the concurrent presence of a surface representation and 
a gradient representation for a region may reduce or 
even abolish the perception of luminosity. Notice that 
both conclusions are not mutually exclusive. 



B. Competing models for luminosity perception 

I briefly discuss three different models in turn which 
could in principle account for the perception of luminos- 
ity. 

[33I suggested an extension to the Retinex theory [2^ [2^ 
such that light sources can be detected in achromatic 
Mondrian displays. The idea is to compute the gradi- 
ent ratio and the intensity ratio between adjacent sur- 
faces. If the ratios are different, then one of the areas 
is a light source (see [4lj for a more detailed discussion 
of this model with respect to the glare effect display). 
Ullman's model thus links luminosity to lightness com- 
putations. 

By measuring the intensities of surfaces, H, and i, 
could establish a relationship between surface area and 
the luminance value at which the surface appeared as be- 
ing luminous (= luminosity threshold). They found that 
(i) a. 17-fold increase in the surface area lead to a 3- fold 
increase in the luminosity threshold, and (ii) for a surface 
to be perceived as light-emitting, its intensity must be 
w 1.7 times larger than the intensity of a non-luminous, 
white surface (under identical illumination conditions). 
To illustrate, consider a simple display where a surface 
is divided into a dark region and a lighter region. The 
luminance ratio of both areas is held constant. Let the 
dark region initially be small, and now gradually increase 
its size with respect to the lighter region. In this case, 
the lighter surface is anchored at white according to the 
Highest-Luminance- As-White^^ (HLAW) rule [3^, and 
the lightness of the darker region will be determined by 
the luminance ratio with the lighter region. Lightness 
will be constant until the relative size of the dark re- 
gion grows bigger than the relative size of the lighter 
region: the area rule applies and perceptual changes are 



produced. Once the darker region is bigger, it appears 
lighter and lighter, until, according to the highest lu- 
minance rule, it is anchored at white (as it approaches 
100% size). However, what happens with the lighter re- 
gion? At first, as the dark region is perceived lighter, it 
remains at white. Thus, a compression of lightness oc- 
curs, despite of the luminance ratio being held constant. 
Gradually, however, the white region gets "whiter than 
white" (or super white, or fluorent). Finally, as the dark 
region approaches 100% and thus white, the white region 
is "forced to relinquish its white appearance and take 
on the appearance of self- luminosity" (see [ll|, p. 803). 
However, as admitted by Gilchrist and colleagues, their 
findings apply only to simple Ganzfeld displays, and yet 
needs to be studied with more complex displays (p. 802). 
Because anchoring is related to lightness and thus to sur- 
face representations, anchoring is not considered by the 
gradient system in its present version. Consequently, no 
area rule applies to the gradient system. The present re- 
sults suggest that gradient representation in the absence 
of concomitant surface representations accounts for the 
perception of luminosity. Note that a luminosity thresh- 
old is revealed as a function of the luminance of the cen- 
tral square (figure fT2|) . The location of the threshold does 
not depend on the spatial frequency of the carrier (that 
is, on the size of the central square). However, the lumi- 
nosity threshold of the gradient system does not depend 
on the luminance of the other squares in the display, and 
therefore is different from the luminosity threshold (i.e., 
the factor 1.7) measured by 

Furthermore, it is not clear how the area rule applies 
to the open glow display of figure |4| the apparent glow 
area is increased with respect to the glow display, but 
this does not seem to compromise the perception of self- 
luminosity. 

The observation that the lighter region appears self- 
luminous if it is sufficiently small with respect to the 
dark region could in principle be explained with the for- 
mation of luminance gradients at the retina (e.g., "ha- 
los", [45|) Such gradients may be produced at small and 
bright stimuli embedded in a darker background due to 
increased pupil size and the major part of the retinal ar- 
ray being adapted to the darker background [l|, [11] . 
The computational model of [13, 0, [13 treats the gen- 
eration of surface representations in the context of the 
anchoring theory of lightness perception [ll|. Surface 
representations are generated by fiUing-in mechanisms. 
Anchoring of perceived reflectance follows a modification 
of the HLAW rule [s^ , which is the Blurred- Luminance- 
As-White-Rule" (BHLAW). The modification overcomes 
problems like that "a point-like small bright patch on 
the visual field will be dealt with the same as a large 
whiteboard occupying most of the visual field" . Thus, 
instead of looking simply for the highest luminance value 
in an image and anchoring it at white, the BHLAW rule 
suggests to anchor the highest value in a low-pass fil- 
tered version of the image at white (where with "image" 
a filled- in surface representations is meant). The percep- 
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tion of luminosity occurs when an image region which 
has the highest filled-in activity is smaller than the size 
of the blurring kernel. This mechanism for producing 
luminosity effects is therefore different from the gradi- 
ent system, because it again measures luminosity on the 
lightness scale. Luminosity effects were demonstrated by 
the BHLAW-model with the "Double BrilHant Illusion" 
, which creates a sensation of glow by using luminance 
gradients analogously to the glare effect display. 
The BHLAW model's overall behavior follows the an- 
choring theory and area rule as described above. An im- 
portant difference between the BHLAW model and the 
gradient system is that the former uses various resolution 
levels or scales for the filling process (although not for the 
blurring kernel for implementing the anchoring process). 

diagonals disk sine biangulai 

piiinii 

FIG. 16: More examples for luminance gradients. The 

second row shows the gradient representations obtained with 
the images from the first row. From left to right: the glow- 
ing diagonals of a luminance pyramid are predicted by the 
gradient system. The brightness enhancement of an Ehren- 
stein Disk with an overlaid luminance gradient is predicted. 
A sine wave grating as an example of a nonlinear luminance 
gradient (doesn't the white stripe in the middle appear to 
glow?). A triangular-shaped luminance profile reveals bright 
and dark Mach bands effects (horizontal stripes), which are 
also predicted by the gradient system. 



C. Conclusions 

Recent psychophysical data concerning the luminos- 
ity effect suggest that luminance gradients are a percep- 
tual feature just like, for example, orientation, contrast 
or color Q. Accordingly, in the present paper, a recently 
proposed theory about the processing of luminance gra- 
dients has been evaluated in the context of luminosity 
perception. The gradient system suggests how luminance 
gradients are processed by the visual system at an early 
level, and how they can give rise to perception of lumi- 
nosity. As gradient representations are thought to be 
complementary to surface representations (i.e., lightness 
computations) , possible interactions between both repre- 
sentations were discussed. Although the gradient system 
is already successful at explaining several brightness illu- 
sions in terms of luminance gradients (see also figure [TO)) , 
mechanisms which address the interactions with surface 
representations and texture information need to be in- 
corporated. However, the precise nature of such mecha- 
nisms have yet to be established by corresponding studies 
in fields like neurophysiology or psychophysics. 
So, why are items displayed on a (light-emitting) com- 
puter screen are not perceived as self-luminous? The an- 
swer is that there are no luminance gradients created by 
the (light-emitting) pixels which could trigger gradient 
representations. Only surface representations are pro- 
duced, and thus the displayed items are perceived on the 
lightness scale. 
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brightness and darkness, and therefore produces analo- 
gous results for inverse displays (darkness enhancement 
when the central square is black, and the ramps terminate 
with black at the central square). I put the terms "per- 
ceived brightness / darkness" in quotes because bright- 
ness is "perceived luminance" and thus already refers to 
a perceptual variable. 

[47] I verified that the step indeed corresponds to a threshold 
by repeating the simulations by choosing smaller incre- 
ments of luminance. The step always appeared no matter 
how small the luminance increments were chosen. 

[48] "Texture" in this context means fine-grained and even- 
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symmetric contrast features. 



